Assessing non-Markovian dynamics 
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We investigate what a snapsiiot of a quantum evolution — a quantum channel reflecting open system 
dynamics — reveals about the underlying continuous time evolution. Remarkably, from such a snapshot, and 
without imposing additional assumptions, it can be decided whether or not a channel is consistent with a time 
(in)dependent Markovian evolution, for which we provide computable necessary and sufficient criteria. Based 
on these, a computable measure of 'Markovianity' is introduced. We discuss how the consistency with Marko- 
vian dynamics can be checked in quantum process tomography. The results also clarify the geometry of the set 
of quantum channels with respect to being solutions of time (in)dependent master equations. 



INTRODUCTION 

Much of the power of information theory, classical and 
quantum, comes from the separation of information from its 
physical carriers. This level of abstraction favors a black box 
approach describing physical processes by their input-output 
relations in discrete time steps. For quantum systems the most 
general black box is described by a trace preserving and com- 
pletely positive map — a quantum channel. This might de- 
scribe the application of a gate in a quantum processor, a quan- 
tum storage device, a communication channel, or any open 
systems dynamics where one merely has partial access to the 
relevant degrees of freedom. In any case it can be considered 
a snapshot of a physical evolution after a certain time. 

In the present letter we investigate what such a snapshot 
reveals about the intermediate continuous time evolution, in 
particular regarding the Markovian and hence memoryless or 
non-Markovian character of the process. This will link the 
black box approach to the dynamical theory of open quan- 
tum systems. Remarkably, fixing a single point in time en- 
ables us to gain non-trivial information about the path along 
which the system has or has not evolved, even without making 
additional assumptions about the physics of the environment 
and its coupling to the system. On the one hand this analy- 
sis thus provides a model-independent means of investigating 
non-Markovian features. On the other hand it tells us which 
type of evolution is required for the continuous realization of 
theoretically given quantum channels. 

On the experimental side recent progress in the field of 
quantum information science showed more and more precise 
determination of input-output relations via quantum process 
tomography. This has by now been achieved in various sys- 
tems including NMR ion traps II4L linear optics imple- 
mentations [3] and solid state qubits Some of them, in 
fact, rely on the a priori assumption that the process in fact 
is Markovian. In the study of open quantum systems as such, 
iion-Markovian processes also move to the center of interest 
||5l|6t]. In general, a precise understanding of decoherence and 
dissipation processes is vital for further improvements and for 



the design of adapted error correcting codes and fault-tolerant 
schemes. Most notably in this context non-Markovian effects 
are known to require a careful analysis 101 ■ 

Before we start, some remarks concerning the central no- 
tions 'Markovian' and 'time-dependent Markovian' are in or- 
der. We will call a quantum channel Markovian if it is an 
element of any one-parameter continuous completely positive 
semigroup, i.e., a solution of a master equation with genera- 
tor in Lindblad form. If the generator depends on time, we 
use the term time-dependent Markovian instead. In both cases 
the continuous evolution is memoryless in that at any point 
in time the future evolution only depends on the present state 
and not on the history of the system. Our findings are: 

(i) The sets of (time-dependent) Markovian channels are 
strictly included within the set of all quantum channels 
and exhibit a non-convex geometry. 

(ii) For arbitrary finite dimensions there is an efficient algo- 
rithm for deciding whether or not a quantum channel is 
Markovian. 

(iii) A computable measure is introduced which quantifies 
the Markovian part of a channel. 

(iv) For qubits a simple criterion for time-dependent Marko- 
vianity is given together with a detailed analysis of the 
geometry of the sets of quantum channels. 

(v) Examples of non-Markovian processes are discussed. 

(vi) An application in the theory of renormalization group 
(RG) transformations on quantum spin chains is out- 
lined. 



PRELIMINARIES 

Throughout we will consider quantum channels on finite di- 
linear maps T : Md -Md ondx d 
T[p) refeiTed to as dynamical maps. 



mensional systems, i.e 
(density) matrices, p 
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reflecting the snapshot in time fs*] . When occasionafly chang- 
ing from Schrodinger to Heisenberg picture we will denote 
the respective map by T*. It will be convenient to consider 
Mil as a Hilbert space equipped with the scalar product 
{A, B)^ = tr[A^ B]. On this space the map T is represented 
by a matrix 

where {Fa}a=i,....d^ is any orthonormal basis in S). Unless 

otherwise stated, we will use matrix units d as 

basis elements. Note that a concatenation of two maps Ti, T2 
simply corresponds to a product of the respective matrices 
T2T1 and that a density matrix p in this language becomes 
a vector with entries {i,j\p) = {i\p\j). A useful operation is 
the involution 

{i,j\f''\k,l) = {i,k\f\j,l) 

llsl [l3l • It connects the matrix representation T of the map to 
its Choi matrix 

= d{T (E) id){Lu) 

where is a maximally entangled state u; — \oj){uj\, \uj) — 
SiLi \h'i)/Vd. Complete positivity is then equivalent to 
> 0. Quantum channels are completely positive and trace 
preserving maps. 

The workhorse in the dynamical theory of open quantum 
systems are semigroups {e*^} depending continuously on one 
parameter t > (time) and giving rise to completely positive 
evolution for all time intervals. Two equivalent standard forms 
for the respective generators have been derived in Refs. Il 1 111 : 
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(1) 



SO L[p) = (j){p) — up — pk\ where G > 0, H = H\ cf) 
is completely positive and 0*(1) — k + k^. A channel wiU 
be called time (in)dependent Markovian if it is the solution 
of any master equation p — L{p) with time (in)dependent 
Liouvillian in Lindblad form ([T]|, i.e.. 



T 



exp 



dt Lt time-ordered. 



drawback of such an approach is the non-convex geometry of 
the set of Markovian channels |12] which inevitably leads to 
the occurrence of local minima. The following approach cir- 
cumvents this problem and guarantees to find the correct an- 
swer efficiently by first taking the log of T and then deciding 
whether this is a valid Lindblad generator of the form ([T]i. 

The latter can easily be decided: a map L : M.d — ^ M.d 
can be written in Lindblad form iff (a) it is Hermitian ifisll . (b) 
L*(l) = corresponding to the trace preservin g pr operty and 
(c) L is conditionally completely positive (ccp) 01411 . i.e.. 



uj^L uji_ > 



(2) 



where uj± = 1 — w is the projector onto the orthogonal com- 
plement of the maximally entangled state (see appendix). 

Before applying (|2]i to logT we need to discuss some 
spectral properties of quantum channels. For simplicity we 
will restrict ourselves to the generic case where T has non- 
defective and non-degenerate Jordan normal form. Hermitic- 
ity of a channel implies that its eigenvalues are either real or 
come in complex conjugate pairs. The Jordan normal form — 
achievable via a similarity transform in the orthonormal basis 
in which the channel is expressed — is then 



T — y ^ XrPr + ^ ] ^cPq 



(3) 



where r labels the real and c the complex eigenvalues respec- 
tively. The P's are orthogonal (but typically not self-adjoint) 
spectral projectors and F is the flip-operator (F|a) (g) |6) = 
\b) (g) \a)). Projectors corresponding to complex conjugate 
eigenvalues are related via P ^ FPF due to Hermiticity of 
the channel which can in turn be expressed as FTF = T. 

Now T is Markovian iff there is a branch of the logarithm 
log T, defined via the logarithm of the eigenvalues in Eq. (O, 
which fulfills the above mentioned conditions (a) - (c). Note 
that (b) is always satisfied if we start from a trace preserving 
map. Moreover, Hermiticity holds iff there is no negative real 
eigenvalue and branches for each complex pair of eigenvalues 
are chosen consistently so that the eigenvalues remain com- 
plex conjugates of each other. If T has negative eigenvalues, 
the dynamics will not be Markovian. The set of Hermitian 
logarithms is then characterized by a set of integers G Z, 



logT 



Lq + 2111 rric 



{Pc - FP,F) 



(4) 



DECIDING MARKOVIANITY 

Given a quantum channel T when is it Markovian, i.e, of 
the form T — e^l A priori, this might be a trivial question: as 
the channel fixes only one point within a continuous evolution, 
there might always be a 'Markovian path' through that point. 
As the attentive reader might akeady guess, this turns out to be 
not the case. One attempt to decide whether T is Markovian 
could be to start from a Markovian ansatz and then calculate 



infLllT 



|, e.g., by numerical minimization. The major 



where Lq denotes the principal branch. The infinity of discrete 
branches looks a bit awkward at first glance, but the problem 
can now be cast into a familiar form. Defining the matrices 

Ac = 2T:i uj^{Pc-¥Pc¥f uji_ 
and applying Eq. (|2]i to L,„ yields that T is Markovian iff 



An 



cA,, > 



(5) 
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FIG. 1: Schematic depiction of tiie (12-dimensionaI) convex set of 
qubit channels. The (dark grey) subset of Markovian channels is 
non-convex and contains 2% of the channels. The larger still non- 
convex set of time-dependent Markovian channels (17%) contains 
all extremal channels. All sets, including the measure zero set of 
indivisible channels (black line) can be found in the neighborhood of 
the identity (dotted circle). 



(iv) basis independence, i.e., M{WTU) = M{T) for all 
unitary channels U and 

(v) an operational or physical interpretation. 

One possibility would again be to start from a distance mea- 
sure inf L I |r — 1 1 which, however, looses much of its appeal 
by the apparent difficulties in computing it. We therefore pro- 
pose a different approach based on the criterion in Eq. (|5]i. 
To this end let us regard Lm as Liouvillian of a master equa- 
tion. If the channel is not Markovian this will not give rise 
to completely positive, i.e., physical, evolution for all times. 
However, adding an additional dissipative term might yield a 
physical Markovian evolution. If we choose isotropic noise of 



the form p 



>+ (1 



fJ- > with coiTe- 



sponding generator £^ — —iiuj± then L, 
valid Lindblad generator for some m iff /i exceeds 



becomes a 



inf {/z > : 3m e Z'^ : Ao + m^Ac + ^1 > 0} 



for any set of integers {md. These matrices Aq^Ac will 
be Hermitian if T has only positive real eigenvalues. Note 
that the real solutions rric € M of Eq. Q form a convex set 
S C K*^ (C being the number of complex pairs of eigenval- 
ues). The present problem is then to decide whether S con- 
tains an integer point. Fortunately, this has an efficient solu- 
tion in terms of a semi-definite integer program. That is, there 
is an algorithm ITsIl which either finds a solution or guaran- 
tees that none exists within a run time of order Id? where I is 



the number of digits to which the input is specified HI6I1 . 

In practice it turns out that checking the vicinity of the prin- 
ciple branch (mc £ {—1,0,1}) is typically sufficient. For 
qubit channels the problem simplifies further since it becomes 
(at most) one-dimensional as C < 1. Hence, one has merely 
to maximize the smallest eigenvalue (a concave function) of 
Eq. (|5]l with respect to real m and then check positivity for 
the two neighboring integers. Note that again, this criterion 
does not necessarily reveal whether the dynamics was truly 
Markovian, but whether it is consistent with it. 



Hence /.tmin is the minimum amount of isotropic noise required 
to make the channel Markovian. Note that /imin can again be 
calculated by semidefinite integer programming and that it is 
basis independent in the sense of (iv). In order to meet the 
normalization condition and to add an intuitive geometric in- 
terpretation to the physical one we use 

Af(r) = exp[/i™„(l-d2)] e [0,1] 

as a measure for Markovianity . If Af) is not Hermitian we as- 
sign M{T) = 0. This turns out to be precisely the factor by 
which the additional dissipation shrinks the output space of 
the channel in order to make it Markovian. In order to see this 
note that the volume of the output space (one might think in 
terms of the Bloch sphere for d = 2) is quantified by the de- 
terminant of the channel [T^. Moreover, det(e^"+'^*'min) — 
gtrL„gtr£,,,^._ = dei{T)M{T), since tr[L,„] is independent 
of m. In this sense M(T) quantifies the Markovian part of the 
channel lil. 



MEASURING MARKOVIANITY 

When applying the above criterion to random quantum 
channels one finds that only a small (but remarkably nonzero) 
fraction of them is Markovian, see Fig.[T] In the following we 
will show how one can quantify the deviation from Marko- 
vianity for the remaining channels. Desirable properties of a 
measure of Markovianity M are: 

(i) some form of normalization, e.g., M e [0, 1] with 
M{T) = 1 iff T is Markovian, 

(ii) computability, 

(iii) continuity. 



DISCUSSION 

Fig.|2](a) shows the Markovianity of a convex combination 
T = pTi + (1 — p)T2 of a unitary channel Ti corresponding to 
7r/4-Rabi oscillation (with Hamiltonian Cx) and a dephasing 
process T2 = with 

L{p) ^ azpcTz - P- 

This confirms the non-convex geometry in Fig. [T] and shows 
that non-Markovian effects can arise from an environment 
which is in a mixture of states each of which leads to a 
Markovian evolution. Interestingly, there also exist non- 
Markovian processes that could have arisen from a Marko- 
vian process when judged from a snapshot in time: The spin- 
star network in Ref. [5] has the property that for all times 
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FIG. 2: Deviation from Markovianity. (a) For a mixture of a 7r/4— era; 
rotation (p = 1) and a dephasing channel (p = 0). (b) For the 
damped Jaynes Cummings model (as a function of time), in which 
a single spin or qubit is coupled to a single cavity mode undergoing 
lossy dynamics. The field mode serves as an intermediate system 
preserving correlations that are relevant for the systems's dynamics. 
The figure shows the interplay between the time scale of truly irre- 
versible cavity losses and apparent decay on the time scale of os- 
cillations, leaving intervals which are consistent with a Markovian 
process (lu — 0.2, 7 — 0.35, ax,z = 1/2, a-y = 1). Also shown 
(dotted) is the evolution of {0|p|0) for initial condition = 1. 



ADDENDUM ON QUANTUM SPIN CHAINS 

Let us finally outline an application of the above results 
within an entirely different field: RG transformations for 
translational invariant states on quantum spin chains. The 
transformation introduced in Ref. |22] amounts to a coarse 
graining consisting of two steps: (1.) build equivalence 
classes of states which only differ by a change of local basis, 
(2.) merge neighboring sites and then iterate. Both steps can 
be carried out explicitly if the state's matrix product represen- 
tation lEsIl uses matrices of finite dimension D. Each equiva- 
lence class then corresponds to a quantum channel T on 
and merging neighboring sites is reflected by replacing T with 
T^. In this sense the renormalization group is identified with 
a semigroup of quantum channels. If T is Markovian, we can 
replace the discrete block spin transformation by an equiva- 
lent continuous RG flow 

Th^ exp[slogr] 



Aq = uj±LqUJ± > 0, and hence the channel is consistent with 
Markovianity. This is perfectly physical, as in each time step 
there could have been a different memoryless evolution. Fig. 
|2] (b) in turn depicts the deviation from Markovianity for the 
damped Jaynes-Cummings model, where the non-Markovian 
character of the dynamics is clearly displayed jlSll . Further 
examples where this competing effect of time scales can be 
observed are non-Markovian models arising from spins cou- 
pled to structured baths with an energy gap as studied, e.g., in 
Ref. lH. 



with s > parameterizing the scale of observation, see Eq. 
(|5]l. This allows then not only to coarse-grain (s > 1) but also 
to zoom in (s < 1). Indivisible channels are also special in 
this context: Since there is no To such that = T they cor- 
respond to starting points, i.e., ultraviolet limits, of RG flows. 
In fact, the best physical approximation to time reversal in this 
way distinguishes the well known ground state of the spin-1 
AKLT Hamiltonian [|24tl . 



SUMMARY 



TIME-DEPENDENT MARKOVIAN CHANNELS 

For deciding whether a channel is a solution of a time- 
dependent master equation we resort to generic qubit chan- 
nels lfl9ll and content ourselves with prese nting results whose 
technical proofs are published elsewhere |10]. A necessary 
and sufficient criterion is most easily expressed in the ba- 
sis of Pauli matrices {Fa} = {1, ctj;, CTj,, (T^j/v^. Let g = 
diag(l, —1, —1, —1) and s; be the ordered square roots of the 
eigenvalues of TgTg. Then T is time-dependent Markovian 
iff det(T) > and sfs^ > ]\^Si Q. This set contains all 
extremal qubit channels (Fig.[T]i, but only 17% of all channels 
iiUl . A paradigmatic example outside this set is 

T(/,) = (tr[p]l + p^)/3, 

which is the best physical approximation to matrix trans- 
position (or time-reversal or — in optics — phase conjugation 
when rotated by (JvY This channels fails the criterion since 
det(T) = -1/27 In fact, it belongs to the pecuHar set 
of indivisible channels that can not be decomposed into a con- 
catenation of two channels unless one of them is unitary. 



In this letter, we have introduced a framework to assess 
whether a given dynamical map describing a physical pro- 
cess could have arisen from Markovian dynamics. To test 
this property we have provided necessary and sufficient condi- 
tions. We also introduced a natural measure of Markovianity, 
quantifying the Markovian content of a process. As such, we 
have provided the means to judge the forgetfulness of a phys- 
ical process from a snapshot in time. 
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Appendix: Deciding Lindblad form 

The following is a modification of the argument given in 
Ref. [ 14] and allows to decide whether or not a map L can be 
written in Lindblad form Eq. ([T]i. It is obvious from ([T]i that L 



5 



has to be Hermitian, i.e., = L{X^) for all X, and that 

L* (1) = 0. Necessity of Eq. dD is seen by exploiting Eq. ([T]i: 

= [{(j) «i id){uj) - (k (g) l)uj - uj{k (g) 

On the r.h.s. the first term is positive and the other terms 
vanish when projected onto uj± = (1 — u). Conversely 
any Hermitian matrix fulfilling inequality (|2|i is of the form 
^ P - \tP){uj\ - with any P > and t/j e C''. To 

arrive at Eq. ([T]i we interpret P as Choi-matrix of a completely 
positive map (p and set (k (8) l)|a;) = 
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